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Estimation  for  the  Rasch  Model 
when  both  Ability  and  Difficulty 
Parameters  are  Random 


Abstract 


M 


Estimation  of  the  parameters  of  the  Raach  model,  a  one 
parameter  item  response  model,  is  considered  when  both  the 
item  parameters  and  the  ability  parameters  are  considered 


random  quantities.  It  is  assumed  that  the  item  parameters  are 

***-  to  he.  «- r 

drawn  from  a  N(4r)  distribution,  and  the  abilities  are  drawn 

J  to  t  J.C.  a  pv-tf 

from  a  N(4^)  distribution.  A  variation  of  the  EM  algorithm  is 


^  > »■  "■  * 


used  to  find  approximate  maximum  likelihood  estimates  of 


and  A  second  approach  assumes  that  the  difficulty 

parameters  are  drawn  from  a  uniform  distribution  over  part  of 


the  real  line.  Real  and  simulated  data  sets  are  discussed  for 


illustration. 


yt 


U  :  (j.iP*  1 


Key  Words  EM  algorithm,  Item  response  curve,  Rasch  model. 


Introduction 


Suppose  that  the  responses  of  n  examinees  to  k  test  items  are  assembled  in  an 
nXk  matrix  T  of  binary  variables,  with  Y  *  1  if  the  ith  examinee's  answer  to  item 

j  is  correct,  and  Y  =  0  otherwise.  It  will  be  assumed  that  the  model  far  the 

ij 

responses  is  the  Rasch  model,  i.e. 


p  =  PCT.-l  |  •.,/!) 
vj  vi  i  j 

=  exp (0-/0  /  [  1  +  exp(fl  -/0  ] 
i  J  i  j 


<u) 


when,  9  k  the  .WUty  of  th»  ith  examinee  and  ^  ie  the  difficulty  t-ramster  for 

item  j.  Here  0  and  ft  may  take  an  any  values  an  the  entire  real  line.  Given  0  =  (0  , 

1 


. . . ,  O  and  £  -  0^. ... .  ffj,  conditional  independence  amon(  the  reaponaee  will  be 


assumed,  i^. 


(1^) 


The  Rasch  model  is  the  simplest  and  probably  the  most  widely  used  model  in 
item  response  theory.  As  Thissen  (1882)  points  out,  there  are  situations  where  the 
Rasch  model  does  fit  test  data  well.  However,  it  is  overly  simplistic  in  some 
situations,  and  so  two  and  three  parameter  models  (2PL  and  3PL)  have  been  proposed 
and  studied.  Estimation  schemes  for  the  2PL  and  3PL  are  usually  much  more 
involved  than  for  the  Rasch  model.  In  addition,  the  2PL  and  3PL  models  require  a 
large  n  in  order  to  accurately  estimate  the  second  and  third  parameters  of  some 
items  (Lord,  1883a).  Thus  when  n  is  small,  under  about  200,  the  2PL  and  3PL  models 
are  not  practical,  and  the  Rasch  model  should  be  used.  The  results  of  this  paper 
should  be  useful  in  these  situations  where  the  Rasch  model  is  appropriate. 
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When  9  and  0  are  both  considered  fixed  but  unknown  quantities,  the  standard 

maximum  likelihr  jd  (ML)  procedure  of  Birnbaum  (1968)  is  applicable  and  has  been 
studied  extensively.  There  have  been  several  recent  proposals  related  to  the  EM 
algorithm  (Dempster,  Laird,  Rubin,  1977)  for  estimating  0  or  B  when  6  is  treated  as 

a  random  sample  from  a  normal  distribution.  For  example,  Sanathanan  and 
Blumenthal  (1978)  give  ML  solution  for  parameters  of  this  normal  distribution  when 
0  is  given,  Bock  and  Aitkin  (1981)  and  Thissen  (1982)  discuss  methods  far  obtaining 

marginal  ML  estimates  of  0 ,  and  Rigdon  and  Tsutakawa  (1983)  discuss  ML  estimation 

of  both  0  and  the  parameter  of  the  normal  distribution.  In  each  of  these  cases 

individual  ability  parameters  can  be  subsequently  estimated  by  computing  the 
posterior  mean  erf*  0  after  replacing  the  unknown  parameters  (ie.,  0  or  the 

fV 

parameter  of  the  normal  distribution)  by  their  ML  estimate. 

It  is  well  known  that  the  maximum  likelihood  estimate  of  ability  is  not  finite 
far  examinees  that  have  a  response  pattern  of  all  correct  or  all  incorrect  answers. 
The  procedures  mentioned  in  the  previous  paragraph  possess  the  advantage  of 
yielding  a  finite  estimate  of  ability  even  in  such  situations.  If  the  number  of 
examinees  is  relatively  small,  it  is  likely  that  the  response  patterns  far  some  items 
will  consist  of  all  zeros  or  all  ones.  In  such  a  situation  the  method  of  maximum 
likelihood  and  the  methods  mentioned  in  the  previous  paragraph  do  not  yield  a 
finite  estimate  of  the  difficulty  parameter.  One  of  the  methods  proposed  in  this 
article  does  have  the  advantage  of  yielding  finite  estimates  of  difficulty  and  ability 
in  these  situations. 

Lord  (1963b)  showed  that  far  3PL  the  maximum  likelihood  estimate  of  ability  is 
positively  biased  for  examinees  with  high  ability  and  negatively  biased  for 
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mriminnrn  with  low  ability.  By  placinc  a  prior  distribution  an  the  ability 
parameters,  as  is  done  for  the  methods  mentioned  previously  and  for  the  methods 
propoeed  here,  the  ability  estimates  are  "pulled"  toward  the  origin.  Lord  (1986)  also 
inHiraton,  again  for  3PL,  that  Bayesian  modal  estimates  of  ability  may  be  biased 
inwards,  but  their  mean  square  error  is  smaller  than  that  for  ML. 

Since  the  Raach  model  is  symmetric,  in  the  sense  that  the  probability  of  correct 
response  depends  only  on  the  difference  between  the  ability  and  difficulty 
parameters,  the  problem  of  bias  exists  far  the  difficulty  parameters.  In  this 
paper  we  deal  with  the  case  where  the  difficulty  parameters  are  also  treated  as  a 
random  «ampl«  from  some  prior  distribution.  The  use  of  a  prior  distribution  for 
the  difficulty  parameters  again  "pulls"  the  estimates  toward  the  origin. 

If  the  parameters  of  the  prior  distribution  for  (0 ,  fi)  are  known,  then  inference 

on  0  or  fi^  can  be  based  on  the  posterior  distribution,  given  the  data  matrix  y .  In 

the  absence  of  known  prior  parameters,  we  consider  replacing  them  by  estimates 
obtained  from  the  data,  and  thus  adopt  a  parametric  empirical  Bayes  (PEB)  approach 
(Morris,  1983).  One  general  procedure  for  estimating  such  prior  parameters  is  by 
maximum  likelihood,  using  the  marginal  likelihood  function  of  the  parameters. 
Unfortunately  this  approach  presents  insurmountable  numerical  problems.  We 
propose  instead  an  approximation  suggested  by  the  CMLF  procedure  of  Rigdon  and 
Tsutakawa  (1963).  For  situations  in  which  prior  knowledge  of  fi  is  diffuse  and  fi 

cannot  be  treated  as  a  random  sample,  we  propose  a  limit  of  the  above  method  by 
taking  the  prior  of  fi  to  be  locally  uniform.  Comparisons  of  these  procedures  to  each 
other  and  to  the  MLF  estimator  of  Rigdon  and  Tsutakawa  (1963)  are  made  by  using 
simulated  data  sets. 


Methodology 


Suppose  now  that  0  ,  6  ,  .  .  .  ,  6  are  selected  from  a  normal  distribution  with 

1  2  ix 

2 

mean  zero  and  variance  a  ,  and  that  /?,/?,...,/?  are  selected  from  a  normal 

i  2  k 

2  ... 

distribution  with  mean  y  and  variance  T  .  The  value  of  (a,y,T)  which  maximizes 
the  marginal  likelihood  of  the  observed  data  y .  i.e. 

p(y  |  a, 7 ,T)  =  /  /  p(y  fi  |  o,7, T)  d 6  d fi  (2.1) 

/v  /v 

is  called  the  marginal  maximum  likelihood  estimator  (MMLE).  However,  under  the 

above  assumptions,  maximization  of  this  quantity  presents  insurmountable 

numerical  problems  since  multidimensional  integrals  must  be  evaluated,  even  if  the 

EM  algorithm  of  Dempster.  Laird  and  Rubin  (1977)  is  applied.  Instead  we  propose  a 

variation  of  the  EM  algorithm,  which  is  similar  to  the  CMLF  method  of  Rigdon  and 

Tsutakawa  (1983).  Note  that  the  posterior  density  of  0  given  (fi  0)  can  be  written 

i  ~ 

p(fl  |  y  fiff)  oc  p(0  |  o)  p(y.  I  O.fi) 

,  ~~  1  wi  1  i 

oc  exp(  r 6  -  0 Z/2 o'  ]  /  [  1  +  exp (B  -  fi )  ]  (2 2) 

Hi  j-1  i  1 

where 


r 

i 


=  f  y.  . 

J=1  14 


is  the  raw  score  of  examinee  i.  Similarly,  the  posterior  density  of  /?  given  (6 ,7 ,t) 


can  be  written 


p(fi.  I  y .  7.  T)  oc  jfifi  I  7,  r)  J?  p(y  y  |  8 ,  fij 

oc  exp(  -qjJ.  -  (fi  -yf)/ZTZ  ]  /  j¥  [  1  +  exp(0  -  /?)  ]  (2.3) 

J  J  j  »  J 


where 


q.  = 

j  1=1  w 

Now  these  densities  are  numerically  tractable,  since,  except  for  normalizing 
constants,  they  are  just  products  of  other  densities  which  are  easy  to  evaluate.  Since 
neither  0  nor  ft  are  available,  we  exploit  this  tractability  by  applying  the  following 

algorithm.  Start  with  some  initial  value  (ft  .,7.  J,  set  m  equal  to  zero  and 

MO)  (0)  (0)  (0) 

repeat  the  following  steps: 

El  Step  Compute  the  posterior  expectations 


and 


9 (1)  =  E(0  |  y  , a  ) 

~  ~  ~  ~(m)  (m) 


0®  =  E(02|yj8  fi  ). 


(2.4) 


(25) 


where  0  2  =  (02,  .  .  .  ,  o\  These  expectations  are  evaluated  by  normalizing  and 


integrating  (22)  times  0  and  0  for  i-1  to  n. 

i  i 

¥2  Step:  Compute  the  posterior  expectations 

ft®  =  tfj)  |  y  ft  ®,y  ,T  ) 

~  o'*  ~  ~  (m)  (m) 


(2.0) 


and 


ft®  =  E(/?2  |  y  ,0  (i),7  ,T  ), 
~  ~  -w  (m)  (m) 


(2.7) 


2.2  2.  (1) 

where  ft  =  (ft  t ... ,  ft  ),  and  set  ft ,  =  ft  .  These  expectations  are  evaluated 

'■'-'1  k  Mra+1)  ^ 


by  normalizing  and  integrating  (2.3)  times  ft  and  ft  for  j=i  to  k. 

j  j 
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(m+l) 


(m+i)  Ui 


(m+i) 


i=i  i  ' 

$  ft  ft. 

J=1  J 

W*-**jr. 


(2-8) 

(2.9) 

(2JD) 


where  0  ^  is  the  i**1  0th)  element  of  the  vector  0  '•'W'W  Increment 

1  J  ^  >V 

m  and  test  for  convergence.  If  convergence  is  attained  to  a  prescribed  level 
then  stop,  otherwise  go  to  the  El  Step. 

Upon  Convergence,  the  final  value  (a,  7.  3)  of  (a,  ,,  7,  ,,  0,  J  maximizes  the  two 

(m)  (m)  (m) 


conditional  likelihood  functions  given  by 
U?  IJ)  *  /  p(y  I  0  ,  P)  p(0  |  a)  d0 

#V  IV  V  V  V 


and 

1(7.  t  |  0)  «  /  p(y  |  0".  /?)  p0»  I  7.  t)  d/l 

v  v  V  V  V  V  IV 

where  (0  .  /f)  satisfies  the  equations 

IV  v 

0”  =  E(0  I  y.  /if.  v) 


and 

0  =  E(j?  I  y.  0".  7.  t). 

v  iv  v 

In  Higdon  and  Tsutakawa  (1983),  CMLF  stood  for  Conditional  Maximum  likelihood 
Fixed  (the  difficulty  parameters  were  fixed,  i.e.  not  random).  Keeping  the  same 
naming  strategy,  we  call  the  method  described  here  CMLR,  for  Conditional  Maximum 
Likelihood  Random  (the  difficulty  parameters  are  considered  random).  It  should  be 
noted  that  all  expectations  required  for  this  method  are  single  integrals  and  must  be 
evaluated  by  using  numerical  techniques.  Gauss-Herznite  quadrature  formulas  are 
appropriate  (see  Stroud  and  Secrest,  1968). 


Once  estimates  for  a,  7,  and  T  are  obtained,  we  estimate  the  0's  and  /7s  by 
evaluating  the  means  of  the  posterior  distributions  as  in  equations  (2.4)  and  (2.6). 
Approximate  interval  estimates  for  the  0’s  and  /7s  can  be  obtained  by  approximating 
the  posterior  distribution  by  a  normal  distribution  using  the  posterior  mean  and 

standard  deviation.  That  is,  the  interval  estimate  for  0  is 

i 

d(i> + z  AP-iPty* 

and  for  fi  the  interval  estimate  is 
j 

J  l-a/2  j  j 

where  is  the  (l-a/2)  point  of  the  standard  normal  distribution  function. 

In  same  cases,  there  is  vague  prior  information  regarding  fi  and  the  assumption 
that  fi  is  a  random  sample  from  a  common  distribution  may  not  be  reasonable. 

/v 

One  Bayesian  solution  to  this  problem  is  to  adopt  an  independent  uniform  prior 
distribution  an  each  fi,.  In  this  case  (y.r)  does  not  exist,  equation  (2.9)  is  not 

neceaau-y  and  the  M  Step  reduce,  to  computin*  *  only.  The  posterior  density  of 


fi  is  now  replaced  by 
j 

p(/?.  I  y  fi )  °c  exp(-/G  q)  /  rf  [  1  +  exp(0.  -  fi)  ]. 
J -  j  j  1=1  i  j 


(2.11) 


This  method  will  be  called  CMLU,  for  Conditional  Maximum  Likelihood  Uniform, 
since  the  prior  is  uniform.  This  method  does  not  have  the  advantage  of  yielding 
finite  estimates  of  the  difficulty  parameter  when  the  response  pattern  for  that  item 
consists  of  all  zeros  or  all  ones. 


An  Example 


We  will  illustrate  our  methods  using  results  from  a  test  of  general  knowledge 
regarding  arthritis,  which  was  administered  to  hospital  patients.  This  data  set  was 
previously  used  in  Tsutakawa  (1984)  and  consists  of  responses  to  k=47  items  by 
n-162  patients.  We  will  compare  the  methods  proposed  here,  i.e.  CMLR  and  CMLU 
with  the  MLF  method  of  Rigdon  and  Tsutakawa  (1963),  since  these  methods  are 
similar  in  the  way  that  they  apply  the  EM  algorithm.  The  CMLF  estimates  are 
nearly  identical  to  the  MLF  estimates.  The  estimates  of  the  prior  parameters,  or  the 
appropriate  sample  statistics,  are  shown  in  Table  I  for  the  MLF  method  and  the  CMLR 
and  CMLU  methods  of  this  article;  the  average  of  the  estimated  abilities  are  also 
shown.  Tables  II  and  m  display  the  estimates  of  the  ability  and  difficulty 
parameters,  respectively.  Both  the  ability  and  difficulty  estimates  obtained  by  MLF 
and  CMLU  are  quite  close.  The  estimates  obtained  by  CMLR  are  somewhat  less 
disperse  than  the  estimates  obtained  by  other  methods. 

I 


Insert  Tables  I,  II  and  III  about  here. 


Simulations 


The  computer-generated  data  sets  of  Rigdon  and  Tsutakawa  (1883)  are  used  here 
to  compare  the  performance  of  the  various  estimation  procedures.  The  ability 
parameters  were  randomly  generated  from  the  standard  normal  distribution.  The 
difficulty  parameters  were  chosen  deterministically  as  the  1,  3,  ....  88  percent 
points  of  the  following  distributions: 

i)  the  standard  normal, 

ii)  the  uniform  over  the  interval  (-3^2 , 3^%  and 

iii)  the  parabolic  U-shaped  with  density  h(x)  =  (5/2 7)x  +  (7/36) 
for  -15  <  x  <  15. 

These  represent  sets  erf  item  parameters  with  difficulties  (i)  concentrated  near  the 
average  ability,  (ii)  spread  out  uniformly,  and  (iii)  sparse  near  the  average.  The  six 
response  matrices  Y  was  then  randomly  generated  using  the  probabilities  of  correct 

response  which  depend  on  9  and  /?  through  the  relation  in  (id). 

The  estimates  of  the  parameters  of  the  prior  distribution  are  shown  in  Table  IV 
for  CMLR  and  CMLU  and  for  the  MLF  method  of  Rigdon  and  Tsutakawa  (1963).  The 
averages  of  the  estimated  abilities  are  also  shown  in  this  table.  For  MLF  and  CMLU 
(where  7  and  T  are  not  part  of  the  model)  the  sample  means  and  standard 
deviations  are  shown  for  comparison.  The  averages  of  the  sets  of  estimates  tend  to 
be  quite  close.  The  major  difference  between  the  sets  of  estimates  seems  to  be  in  the 
dispersion.  The  difficulty  estimates  obtained  by  CMLR  tend  to  be  less  disperse  than 
those  far  the  other  methods.  Ability  estimates  from  CMLR  are  also  less  disperse,  but 
this  is  not  as  pronounced. 


Insert  Table  IV  about  here 


Comparisons  can  be  maria  between  the  actual  values  and  the  estimated  values  since 
the  data  were  simulated.  A  measure  of  the  accuracy  of  these  procedures  is  the  root 
mean  squared  deviations  (RMSD's), 

|  E.  (9.  -  3)% ! 1/2 
1  1 

and 

I  s,  09.  -  if/ k  t,z 

J  J 

where  9  and  0  are  estimates  of  6  and  fi .  The  RMSD's  for  the  MLF.  CMLR  and  CMLU 
i  j  i  j 

methods  are  given  in  Table  V.  In  most  cases  the  performances  of  the  procedures  are 
quite  close.  In  some  cases  the  RMSD  of  the  CMLR  estimates  of  difficulty  are 
considerably  less  than  the  RMSD's  for  the  other  methods.  Two  at  these  cases  occur 
when  the  distribution  of  the  0s  was  chosen  to  be  ’TJ” -shaped,  indicating  that  the 
CMLR  method  is  robust  with  respect  to  the  assumption  that  the  0s  come  from  a 
normal  distribution. 


Insert  Table  V  about  here 


The  frequencies  of  actual  values  within  two  posterior  standard  deviations  of  the 
estimates  are  also  shown  in  Table  V.  As  can  be  seen  from  this  table,  close  to  06  per 
cent  of  the  estimates  are  within  these  limits,  a  result  we  would  expect  if  the 
posteriors  were  normally  distributed.  This  indicates  that  the  posterior  distribution 
may  be  useful  in  assessing  the  uncertainty  in  an  estimate  of  9  or  0 . 


Discussion 


A  Bayesian  who  has  not  seen  the  items  may  be  inclined  to  assume  that  the  prior 
distribution  of  0  is  exchangeable.  This  person  may  then  find  it  convenient  to 

represent  the  exchangeable  prior  through  a  normal  distribution  having  a 
hyperparameter  with  a  subjective  prior  distribution.  A  frequentist,  on  the  other 
hand,  may  view  0  as  a  random  sample  from  a  larger  population  associated  with  a 

large  or  hypothetically  large  item  pool.  This  person  might  then  find  it  convenient  to 
view  this  population  as  one  having  a  normal  distribution  which  can  be  estimated. 
Our  first  estimate,  CMLR,  conforms  more  to  the  latter  point  of  view,  whereas  our 
second  estimate,  CMLU,  is  more  compatible  with  the  former  when  the  prior  for  fi  is 

diffuse. 

We  feel  that  our  method  can  be  recommended  in  situations  where  there  are 
relatively  few  examinees  and  there  is  limited  information  about  the  item  response 
curves.  When  the  data  satisfies  the  assumptions  for  the  Rasch  model  and  n  is 
larger,  our  estimates  should  be  in  close  agreement  with  the  conventional  ML 
estimates.  For  small  n,  not  only  does  one  have  problems  with  the  nonexistence  of 
ML  estimates,  but  the  asymptotic  properties  for  measuring  the  precision  of  these 
estimates  will  be  of  limited  value.  Our  method  seems  particularly  suitable  for 
handling  such  cases. 

The  extension  of  our  approach  to  2PL  and  3PL  is  clearly  possible.  Such 
extensions  would  require  introducing  additional  distributions  for  the  additional  item 
parameters  and  developing  efficient  techniques  for  numerically  evaluating  two  and 
three  dimensional  integrals,  corresponding  to  (2.6)  and  (2.7). 
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Table  I 


Estimates  of  Parameters  of  Prior 
Distribution  for  Arthritis  Test 


Method 

2  9/102 
■ 

a 

7 

MU 

0.00 

0.70 

-0.90* 

CXLR 

0.02 

0.76 

-0.88 

0.01 

0.78 

-0.80* 

*  Sample  statistics  used  in  these  entries. 
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Table  II 


Estimates  of  Abilities  for  Arthritis  Test 


47 

44 

42 

41 

40 

39 

38 

37 

38 
35 
34 
33 
32 
31 


29 

28 

27 

26 

25 

24 


NLP 

2.20 

1.61 

1.29 

1.14 

1.00 

0.87 

0.74 

0.62 

0.50 

0.38 

0.27 

0.16 

0.06 

-0.05 

-0.15 

-0.26 

-0.36 

-0.44 

-0.54 

-0.64 

-0.73 

-0.83 

-0.92 


QO _ Qcyj 


2.16 

2.20 

1.60 

1.61 

1.28 

1.29 

1.13 

1.14 

1.00 

1.00 

0.87 

0.87 

0.76 

0.74 

0.63 

0.62 

0.51 

0.50 

0.40 

0.38 

0.29 

0.27 

0.19 

0.16 

0.08 

0.06 

-0.02 

-0.05 

-0.12 

-0.16 

-0.22 

-0.25 

-0.31 

-0.36 

-0.41 

-0.44 

-0.60 

-0.54 

-0.60 

-0.64 

-0.69 

-0.73 

-0.78 

-0.83 

-0.87 

-0.92 

-ao- 


Table  in 

Estimates  of  Difficulty  Parameters  for  Arthritis  Test 


Scort 

KLF 

CML& 

SHm*  >**■ ' 

149 

-2.86 

-2.83 

-2.68 

148 

-2.60 

-2.46 

-2.69 

146 

-2.44 

-2.30 

-2.43 

148 

-2.37 

-2.23 

-2.36 

143 

-2.24 

-2.13 

-2.22 

141 

-2.11 

-2.03 

-2.10 

139 

-2.00 

-1.91 

-1.98 

136 

-1.84 

-1.73 

-1.83 

138 

-1.79 

-1.68 

-1.78 

133 

-1.70 

-1.62 

-1.68 

132 

-1.66 

-1.60 

-1.64 

130 

-1.87 

-1.64 

-1.66 

123 

-1.29 

-1.17 

-1.27 

122 

-1.28 

-1.14 

-1.23 

121 

-1.21 

-1.13 

-1.20 

118 

-1.11 

-1.09 

-1.09 

117 

-1.07 

-1.08 

-1.06 

116 

-1.00 

-i:o3 

-0.99 

110 

-0,84 

-0.78 

-0.83 

107 

-0.78 

-0.64 

-0.74 

103 

-0.62 

-0.60 

-0.61 

98 

-0.48 

-0.83 

-0.47 

94 

-0.36 

-0.33 

-0.38 

93 

-0,33 

-0.27 

-0.33 

88 

-0.19 

-0.11 

-0.19 

87 

-0.16 

-0.11 

-0.16 

82 

-0,02 

-0.08 

-0.02 

81 

0.00 

-0.07 

0.01 

80 

0.03 

-0.06 

0.03 

72 

0.26 

0.34 

0.28 

71 

0.28 

0.37 

0.28 

62 

0.84 

0.48 

0.84 

61 

0.87 

0.47 

0.66 

87 

0.69 

0.67 

0.68 

80 

0.91 

0.91 

0.90 

43 

1.14 

1.04 

1.13 

37 

1.36 

1.36 

1.36 

27 

1.79 

1.70 

1.77 
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KO,  1) 


Uniform 


Uniform 


Table  IV 

Estimates  of  Parameters  of  Prior 
Distribution  for  Simulated  Data  Sets 

n  Method  £  3  /n  <7  7 


”U"~shmped  60 


”U”-shmped  200 


*  Snapl*  ntmtlntlcs  used  in  those  entries. 
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Table  V 

Comparison  of  Actual  and  Estimated  Values: 
Simulated  Data  Sets 

Freq.  of  0  Freq.  of  fi 

ffs _ n. _ Method  RMSD  9  RMSD  B  within  2  s.d.  within  2  sxi. 


KLF 

0.394 

0.311 

48 

- 

><0.1> 

50 

CNLR 

0.355 

0.319 

48 

48 

CNLU 

0.425 

0.311 

48 

47 

KLF 

0.173 

0.322 

191 

- 

KO.l) 

200 

CNLR 

0.173 

0.324 

189 

47 

CNLU 

mssm 

0.324 

190 

48 

KLF 

0.263 

0.326 

48 

- 

Uaifora 

50 

CNLR 

0.266 

0.324 

48 

46 

CNLU 

0.265 

0.326 

48 

49 

KLF 

0.155 

193 

- 

Ualfon 

200 

CNLR 

192 

48 

CNLU 

0.155 

193 

49 

KLF 

0.336 

48 

- 

"U^-eluiped 

50 

CNLR 

0.318 

0.300 

49 

60 

CNLU 

0.298 

48 

50 
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